Web Survey Bibliography
Title Analysing and visualising logfiles: the Individualised SiteMap tool ISM
Author Kralisch, A., Berendt, B.
Year 2005
Access date 21.04.2005
Abstract User behaviour in interactive software environments can be analysed conveniently with the help of logfile data that are recorded non-reactively and non-obtrusively. Various tools exist that provide powerful statistical analyses of these data, aiding in a wide range of usability studies and online experiments. However, statistics are often insufficient for understanding the data. Exploratory analyses and hypothesis generation are best supported by visualizations that capture essential features of content and structure of data and behaviour, and that allow the analyst to make abstractions that are useful for the domain and question at hand. The Individualised SiteMap tool (http://vasarely.wiwi.hu-berlin.de/ISM) is suited for all domains in which user behaviour can be modelled as a graph –{:} a prominent example is navigation in Web sites. ISM shows the names of Web pages (or other information units) that a user has visited and the order of visits, providing for a content analysis of user paths. To provide for a complementary structural analysis, ISM uses a specialized layout algorithm that transforms typical features of these paths into prominent visual patterns, e.g., linear vs. nonlinear and hub-and-spoke navigation, and the emergence of landmarks. Colour is employed to emphasize structuring by content, user features, or task features. An ISM thus depicts a user’{:}s individual view of the site, as expressed by her/his exploration behaviour. Structural abstraction is offered by graph abstractions that translate into visualizations of selected behavioural aspects. Content abstraction is provided by support for aggregating logfiles using concept hierarchies. The advantages of the approach are demonstrated using data from a field study that investigated the impact of culture, language, and domain knowledge on navigation in an international E-Health portal, and from a laboratory study that investigated the impact of cognitive styles and abilities on information search in an education portal. The combination of ISM with data mining analyses is discussed. The Individualised SiteMap tool is a development based on STRATDYN first presented in Berendt & Brenstein (Beh. Res. Meth., Instr., & Comp. 2001){:} it supports more analysis options and interactivity, it is platform-independent, and it can be used freely for academic purposes.
Abstract - optional Das Nutzerverhalten in interaktiven Software-Umgebungen kann mit Hilfe von Logfile-Daten, die nicht-reaktiv und ohne Nutzungsbeeinträchtigung aufgezeichnet werden, bequem analysiert werden. Verschiedene Werkzeuge bieten mächtige statistische Analysemöglichkeiten für diese Daten und bilden somit einen wesentliche Hilfe für Usability-Studien und Online-Experimente. Jedoch genügen Statistiken oft nicht, um die Daten zu verstehen. Explorative Analysen und Hypothesengenerierung werden am besten von Visualisierungen unterstützt, die inhaltliche und strukturelle Kerneigenschaften von Daten und Verhalten einfangen, und die dem Untersuchenden Abstraktionen erlauben, die für die Domäne und Fragestellung nützlich sind. Das Individualised SiteMap-Werkzeug (http://vasarely.wiwi.hu-berlin.de/ISM) eignet sich für alle Domänen, in denen Nutzerverhalten als Graph modelliert werden kann –{:} ein prominentes Beispiel ist die Navigation in Websites. ISM zeigt die Namen der Webseiten (oder anderer Informationseinheiten), die ein Nutzer besucht hat, und die Reihenfolge dieser Besuche und erlaubt somit eine Inhaltsanalyse der Nutzerpfade. Eine hierzu komplementäre Strukturanalyse wird durch einen spezialisierten Layout-Algorithmus unterstützt, der typische Charakteristika dieser Pfade in spezifische visuelle Muster übersetzt, wie z.B. lineare vs. nichtlineare Navigation, hub-and-spoke-Navigation, und die Entstehung von Landmarken. Farbe zeigt die Strukturierung nach Inhalt, Nutzer- oder Aufgabeneigenschaften. Eine ISM zeigt somit die individuelle Sicht eines Nutzers auf die Site, wie sie sich in seinem Explorationsverhalten ausdrückt. Strukturelle Abstraktion wird durch Graph-Abstraktionen unterstützt, die sich in Visualisierungen ausgewählter Verhaltensaspekte umsetzen. Inhaltsabstraktion wird durch die Aggregation von Logfiles mittels Konzepthierarchien unterstützt. Die Vorteile des Ansatzes werden anhand von zwei Untersuchungen demonstriert: einer Feldstudie zum Einfluss von Kultur, Sprache und medizinischem Wissen auf die Navigation in einem internationalen E-Health-Portal, und einer Laborstudie zum Einfluss kognitiver Stile und Fähigkeiten auf die Informationssuche in einem Bildungsportal. Mögliche Verbindungen von ISM mit Data-Mining-Analysen werden beschrieben. Das Individualised SiteMap-Werkzeug ist eine Weiterentwicklung von STRATDYN, welches in Berendt & Brenstein (Beh. Res. Meth., Instr., & Comp. 2001) vorgestellt wurde{:} es unterstützt eine breitere Palette von Analyse- und Interaktivitätsoptionen, ist plattform-unabhängig und steht für Forschungszwecke frei zur Verfügung.
Access/Direct link Homepage - conference (abstract)
Year of publication2005
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - 2005 (76)
- The ethics of research using electronic mail discussion groups; 2005; Kralik, D., Warren, J., Koch, T., Pignone, G., Price, K.
- The Analyses of Domestic Study about Internet Survey; 2005; Rui, L., Tie-ying, S.
- Controlling the Baseline Speed of Respondents: An Empirical Evaluation of Data Treatment Methods of...; 2005; Mayerl, J.
- Determinanten der Rücklaufquote in Online-Panels; 2005; Batanic, B., Moser, K.
- On the cost-efficiency of probability sampling based mail surveys with a Web response option; 2005; Werner, P.
- Expert workshop on mixed mode data collection in comparative social surveys; 2005; Roberts, C.
- The Effect Of A Simultaneous Mixed-Mode (Mail And Web) Survey On Respondent Characteristics And Survey...; 2005; Brennan, M.
- The total survey error approach. A guide to the new science of survey research; 2005; Weisberg, H. F.
- The professional respondent problem in online panel surveys today; 2005; Fulgoni, G.
- Satisficing behavior in online panelists; 2005; Downes-Le Guin, T.
- Reading behavior in the digital environment: Changes in reading behavior over the past ten years; 2005; Liu, Z.
- Rating versus comparative trade-off measures. Trending changes in political issues across time and predictive...; 2005; Thomas, R. K., Behnke, S., Johnson, Al., Sanders, M.
- Publication bias: Recognizing the problem, understanding its origins and scope, and preventing harm; 2005; Dickersin, K.
- Panel proliferation and quality concerns; 2005; Faasse, J.
- Gricean effects in self-administered survey. Ph.D. Dissertation; 2005; Yan, T.
- Drop-down boxes, radio buttons, or fill-in-the-blank? Web survey scale-type effects; 2005
- Does weighting for nonresponse increase the variance of survey means?; 2005; Little, R. J., Vartivarian, S.
- Big scale observations gathered with the help of client side paradata; 2005; Haraldsen, G., Kleven, O., Sundvoll, A.
- User Interface Design and Evaluation ; 2005; Stone, D., Jarrett, C., Woodroffe, M., Minocha, S.
- Adding Value to Data Through Improved Access. The Case for Web Portals; 2005; Baker, R. P.
- Multi-Mode Research and Data Linkage. Theoretical and Practical Advice; 2005; Terhanian, G.
- Architectural Design of a Survey Questionnaire and Respondent Data Repository. Practical Considerations...; 2005; Cookson, P., Sobell, J.
- Developing and validating a nursing website evaluation questionnaire; 2005; Tsai, S. - L., Chai, S.-K.
- Workaround: Site’s surveys beat pop-up blockers, yield responses; 2005; Arnold, C.
- The Story of Subject Naught: A Cautionary but Optimistic Tale of Internet Survey Research; 2005; Konstan, J. A., Ross, M. W., Rosser, B. R. S., Stanton, J. M., Edwards, W. M.
- Standards in Online Surveys. Sources for Professional Codes of Conduct, Ethical Guidelines and Quality...; 2005; Kaczmirek, L., Schulze, N.
- Computer adaptive testing; 2005; Gershon, R. C.
- Ego control and ego-resiliency: Generalization of self-report scales based on personality descriptions...; 2005; Block, J., Funder, D. C., Letzring, T. D.
- The Web experiment list: A Web service for the recruitment of participants and archiving of Internet...; 2005; Reips, U. -D., Lengler, R.
- Survey of substance use among high school students in Taipei: Web-based questionnaire versus paper-and...; 2005; Wang, Y. C., Lee, C. M., Lew-Ting, C. Y., Hsiao, C. K., Chen, W. J.
- Web Surveys. A Brief Guide on Usability and Implementation Issues; 2005; Kaczmirek, L.
- An assessment of measurement invariance between online and mail surveys ; 2005; Deutskens, E., de Ruyter, K., Wetzels, M.
- E-mail versus Web survey response rates among health education professionals; 2005; Kittleson, M. J., Brown, S. L.
- Toward An Open-Source Methodology: What We Can Learn From The Blogosphere; 2005; M.
- Aux Abonnes Absents: Liste Rouge Et Telephone Portable Dans Les Enquetes En Population Generale Sur...; 2005; Beck, F., ., Peretti-Watel, P.
- Web Versus Paper Questionnares: A Design and Functionality - Comparison; 2005; Jones, Ja., Fraser, C., Dowling, Z.
- Web Surveys and the new Disability Discrimination Act; 2005; Macer, T.
- Mixed-mode Surveys Using Mail and Web Questionnaires; 2005; Meckel, M., Baugh, P., Walters, D.
- Sampling procedure, questionnaire design, online implementation; 2005; Jackob, N., Arens, J., Zerback, T., Jowell, R., de Rouvray, C.
- Simple Approaches to Estimating the Variance of the Propensity Score Weighted Estimator Applied on Volunteer...; 2005; Isaksson, A., Lee, S., de Rouvray, C.
- Simple Approaches to Estimating the Variance of the Propensity Score Weighted Estimator Applied on Volunteer...; 2005; Isaksson, A., Lee, S.
- Alternative Modes for Health Surveillance Surveys: An Experiment with Web, Mail, and Telephone; 2005; Link, M. W., Mokdad, A.
- An Experimental Comparison Of Web And Telephone Surveys; 2005; Fricker, S., Galesic, M., Tourangeau, R., Yan, T.
- Organizational Virtual Communities: Exploring Motivations Behind Online Panel Participation; 2005; Daugherty, T., Lee, W.-N., Gangadharbatla, H., Kim, K., Outhavong, S.
- Promoting Uniform Question Understanding in Today's and Tomorrow's Surveys; 2005; Conrad, F. G., Schober, M. F.
- Is a Web survey as effective as a mail survey? A field experiment among computer users; 2005; Kiernan, N. E., Kiernan, M., Oyler, M. A., Gilles, C.
- The effect of personalization on response rates and data quality in web surveys; 2005; Heerwegh, D., Vanhove, T., Matthijs, K., Loosveldt, G.
- When Methodology Interferes With Substance; 2005; Schoen, H., Faas, T.
- Web-based and Mailed Questionnaires: A Comparison of Response Rates and Compliance; 2005; Baelter, K., Balter, O., Fondell, E., Trolle-Lagerros, Y.
- Bleeding Edge or Proven Technology? The Fact and the Fiction of Mobile Survey Computing; 2005; Cameron, M. R.